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In social networks with positive and negative links 
the dominant theory of explaining its structure 
is that of social balance.^ ^ The theory states 
that a network is balanced if its triads are bal- 
anced. Such a balanced network can be split 
into (at most) two opposing factions with posi- 
tive links within a faction and negative links be- 
tween themP Although inherently dynamical, the 
theory has long remained static, with a focus on 
finding such partitions.^ ^ Recently however, a dy- 
namical model was introduced^ which was shown 
to converge to a socially balanced state for cer- 
tain symmetric initial conditions.^ Here we show 
this does not hold for general (non-symmetric) 
initial conditions. We propose an alternative 
model and show that it does converge to a so- 
cially balanced state generically. Moreover, in 
a basic model of evolution of cooperation of in- 
direct reciprocity,!^ the alternative model has an 
evolutionary advantage compared to the earlier 
model. The principal difference between the two 
models can be understood in terms of gossip- 
ing: we assume people talk about how others 
treated them, while the earlier model assumed 
people talk about what they think of others. 
Both gossiping and social balance are at the cen- 
tre of many social phenomenaj^li^ such as norm 
maintenance,'^^ stereotype formation^ and social 
conflict, rendering it important to understand 
their underlying principles. 

In balanced triads friends agree in their opinion of a 
third party, while foes disagree (Fig. [I]). Triads that 
are unbalanced are unstable: they have an incentive to 
change to reduce the stresJ^^ inherent to such situations. 
The central question is how this translates into a dynam- 
ical model that converges provably to a socially balanced 
state for (almost) all initial co nditio ns. Some discrete 
dynamics have been investigatedp^EHfor which so-called 
jammed states exislP^l such that no change of sign will 
improve the degree of social balance. One surprisingly 
simple model was proven to converge to social balance 
for certain symmetric initial conditions.'^ The authors as- 
sume a complete graph (everybody connected to every- 
body), with weighted links that change in a continuous 
manner. Let X be the matrix of relationships between 
nodes, so that Xij is positive whenever node i considers j 
a friend, and that Xij is negative whenever node i thinks 
of j as an enemy. The changes in these relationships are 
then modelled as 



Balanced 



Unbalanced 



Two Factions 



FIG. 1. Social Balance. The two upper triads are balanced, 
while the two lower triads are unbalanced. According to the 
structure theorem^ a complete graph can be split into two 
opposing factions, if and only if all triads are balanced. This 
is represented by the coloured matrix on the right, where blue 
indicates positive entries, and red negative entries. 



where X denotes the time derivative of the matrix X. 
The implicit idea for this model is that some gossiping 
takes place. For example, suppose Bob and Alice are 
friends, and Bob wants to revise his opinion of John. Bob 
then asks Alice her opinion of John, and Bob will adopt 
Alice's opinion. On the other hand, if Bob and Alice are 
foes, Bob will adopt the opposite of Alice's opinion. 

The analysis for symmetric initial conditions is quite 
straightforward. Given that the initial condition A(0) — 
X^(0), we can diagonalise it using X{0) = L/A(0)J7^, 
where U is an orthogonal matrix containing the eigen- 
vectors ui, . . . ,Un of X{0) and A(0) is a diagonal matrix 
containing the (real) eigenvalues Ai > A2 > • • • > A„. 
It then follows that X{t) = Uk{t)U'^ where Kit) is the 
solution of A = A^ . The solution can be given explicitly 
in terms of A, and reads 



A,(i) = 



A,(0) 



1 - A,(0)t 



(2) 



which blows up at time t* 



A.(0) 



X = X\ OT X,,=Y,X,kX^ 



kj 



(1) 



if A,(0) > 0. Hence if 

Ai(0) > A2(0) and positive, the largest eigenvalue blows 
up first. If we normalise by the norm of X(t), we ob- 
tain that limt_i.fj — uiu^ . By looking only at 
the signs of the links (and not their magnitude), the 
vector product will correspond exactly to two factions. 
This result can be generalised to normal initial condi- 
tions for which X{0)X^{0) = A^(0)A(0) holds (see SI 
Theorem [2]). Hence, under quite general conditions one 
obtains social balance. 
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FIG. 2. The two models compared. The first row iUustrates what happens genericaUy for the model X = X^, while the second 
row displays the results for X — XX'^ . Each row contains from left to right: (1) an illustration of the model; (2) the random 
initial state; (3) the dynamics of the model; and (4) the final state to which the dynamics converge. Blue indicates positive 
entries, and red negative entries. Although the first model converges to a rank one matrix, it is not socially balanced. The 
second model does converge genericaUy to social balance. The small bumps in the dynamics for X = are due to complex 
eigenvalues that show circular behaviour. 



However, this result is restricted to symmetric (or 
strictly speaking, normal) initial conditions. Although 
the theory of social balance is formulated for undirected 
networks — hence a symmetric matrix — there is no reason 
to assume the initial condition should also be symmetric. 
Indeed, although Bob may like Alice, this feeling need 
not be mutual. So, let us turn to the analysis of general 
(non-symmetric) initial conditions. 

Unfortunately, for general initial conditions conver- 
gence to social balance is no longer guaranteed. To solve 
the general case we use the Jordan decomposition, which 
yields X{0) = J7A(0)C/^^, where U is now no longer or- 
thogonal, and A(0) consists of Jordan blocks. The gen- 
eral solution is rather involved (see SI Theorem [s]), but 
for simple Jordan blocks (i.e. all eigenvalues have multi- 
plicity one), the behaviour already becomes apparent. 

The dynamics of the real eigenvalues remain as de- 
scribed by Eq. ([2|. The complex eigenvalues, which cor- 
respond to 2 X 2 blocks in A, behave quite differently: they 
tend to asymptotically while describing a circle in the 
complex plane. Hence, the blow-up behaviour present for 
the largest positive real eigenvalue remains unaffected. 
So, as long as there is a real positive eigenvalue, the nor- 
malised system still converges to a rank one matrix. How- 
ever, the eigenvectors U are no longer orthogonal, and 
the system converges to limt_j.(. ||^|*||| = uiv^ , where ui 
and vi are the corresponding right and left eigenvector. 
This generally does not correspond to a socially balanced 
state (Fig. [2]). Concluding, convergence to social balance 



will unlikely be observed for general random initial con- 
ditions. 

Let us briefly reconsider the implicit gossiping process 
in the model X ~ X^ . In our example of Bob, Alice and 
John, the following happens. Bob asks Alice what she 
thinks of John. Bob takes into account what he thinks of 
Alice, and adjusts his opinion of John accordingly. How- 
ever, Alice might not talk about what she thinks of John, 
but about how John treated her, or what he did. This is 
also what is observed in studies on gossip: it usually con- 
cerns what others did, not what one thinks of others.'^SEll 
A reasonable assumption then is that John treats Alice 
in line with his opinion of Alice: he will treat her badly 
when he thinks badly of her, and treat her well when he 
thinks highly of her. 

Alternatively, we could consider a type of homophily 
process!^^^ people tend to befriend similar people. 
When Bob seeks to revise his opinion of John, he talks to 
John about everybody else. For example, suppose Bob 
likes Alice, while John dislikes her. When Bob and John 
talk about Alice, they disagree on their opinion of her, 
and as a result their relationship deteriorates. On the 
other hand, should they agree, their relationship would 
improve, and the more they agree, the more the relation- 
ship improves. Either way, we arrive at the model 

X = XX^, or X,j = X,kX,k- (3) 

k 

Although this is a subtle difference, it is a crucial one, as 
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X = X' X = XX ' 
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FIG. 3. Fixation probability. Fixation means that a certain 
type is the only surviving type in the evolutionary dynamics. 
It shows that the model X = XX^ is more viable against 
defectors, and has an evolutionary advantage compared to 
X = 



we will show. 

For symmetric conditions both models ([T]) and ([3| 
are exactly equal. For general conditions, things are 
quite different, and system (|3| converges to a socially 
balance state. In order to so ve this case, we decom- 
pose into a symmetric and skew-symmetric part: X(t) — 
S{t) + A{t). Since X — the skew-symmetric part 
remains constant and A{t) = A{0) = Aq, while the sym- 
metric part obeys S = {S + Aq){S — Aq). Introduc- 
ing S{t) — e^^"'^ S{t)e^°^ we can simplify this equation 

to S = S'^ + AqAq . Furthermore, we can diagonalise 
AoAq — D"^ using its eigenvectors V, such that the di- 
agonalisation has ujf on the diagonal where zLiuji are the 
complex eigenvalues of ^o- Using the theory of Riccati 
differential equations, we can find an explicit solution of 
the resulting equation. Assuming Aq is invertible, we 
obtain 



S{t) = -e^"'VP{t)p-^{t)V^e 



-Aat 



(4) 



with Pit) = cos{Dt) - sm{Dt)V'^S{0)V. When Aq 
is not invertible a similar expression can be provided 
(see SI Eq. |C26[ ). This is valid for t = [0,t*) with t* 
the first blow up time, which is always finite for non- 
zero Aq. This expression can be used to show that 
limt_j.t* X(i)/||X(i)|| — wuF for some vector w (see The- 
orem [s] in SI) for a dense set of initial conditions X(0). 
Hence the system generically evolves to social balance 
(Fig. [2]). 

This has important consequences for many fields in 
social science. Gossiping is often regarded as fundamen- 
tal to many social processes and phenomena .I^E^ For ex- 
ample, a classic worl|l2' on the established and outsiders 



found that gossiping was the fundamental driving force 
for the maintenance of the cohesive network of the estab- 
lished and the exclusion of the outsiders. Our analysis 
shows that networks typically split into (at most) two 
mutually antagonistic factions when such gossiping pro- 
cesses take place. 

Besides these important areas, reputation and gos- 
siping also appear naturally in the study of the evo- 
lution of cooperation. Indirect reciprocity is regarded 
as one of the main explanations for the breadth of 
human cooperation.'^ It is based on reputations, usu- 
ally tacitly assumed to be formed through gossip- 
ing. Although many different strategies have been 
investigated,^"' ^ only few works actually study how gos- 
siping shapes reputations.'^^'^ Nevertheless, it was ob- 
served that gossiping is an effective mechanism for pro- 
moting cooperation.^^ ■^^ 

We will briefly consider evolutionary dynamics involv- 
ing the two models. We assume a Prisoner's Dilemma 
type of game. All agents can either cooperate or defect 
with one another, and we will assume agent i will co- 
operate with agent j whenever Xij{t) > and defect 
otherwise. The cost of cooperating is c = 1, while the 
benefit of cooperating is 6 > c. In this setting it makes 
little sense to assume relations should be symmetric. Af- 
ter all, whenever somebody cooperates, it may well serve 
his partner to defect. 

We initialise the population with ua = 30 agents that 
use X = X^ dynamics (Type A); and n_B = 30 agents 
that use X = XX^ dynamics (Type B). We let the popu- 
lation evolve according to the payoff until one of the types 
has become fixated. We repeat this process many times 
and keep track of how often a certain type has become 
fixated (see SI section [D] for details) . If types become 
fixated with probability above 1/2 it indicates an evolu- 
tionary advantage. The results are displayed in Fig. [3] 
When directly competing against each other, type B has 
an evolutionary advantage over type A, when the benefit 
is sufficiently high. We have also simulated the situation 
when each type is playing against defectors (agents that 
always defect). Type A seems unable to defeat defectors 
for any b < 20, while type B performs quite well against 
them. 

To conclude, we have shown that the alternative model 
X — XX^ (almost) always converges to social bal- 
ance. Furthermore, it appears that these type of agents 
have an evolutionary advantage compared to agents using 
X = X"^, and perform well against defectors. Contrary to 
other models of indirect reciprocity, not everybody might 
end up cooperating with everybody, and the population 
may split into two groups. This provides an interesting 
connection between social balance theory, gossiping and 
the evolution of cooperation. Our results may have im- 
portant ramifications in thinking and modelling in vari- 
ous social science disciplines, for which gossip remains at 
the nexus. 
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Supplementary Information A: Preliminaries 

In this paper we are concerned with certain matrix differential equations of the form 

X^F{X,X^), (Al) 

where X is a real n x n matrix, and is a one of two specific, smooth functions. These functions are such that it 
turns out to be advantageous to consider the dynamics of the symmetric and skew-symmetric parts of X. Recall that 

where S is the linear subspace of real symmetric matrices, and A the linear subspace of skew-symmetric matrices. 
Thus, given any X G K"^", we can find unique symmetric S G S and skew-symmetric A G A such that: 



More explicitly. 



Moreover, using the inner product 



there holds that 



X^S + A. 



o x + x^ ^ X-X^ 
S = , A = . 



{X,Y)=tT{XY^), 



A-^ - S. (A2) 
The norm induced by this inner product is the Frobenius norm: 

\X\F^{tT{XX^)f2. (A3) 
Recall that the Frobenius norm is unitarily invariant, i.e. if U is orthogonal (i.e. C/J7"^ = /„), then 

\UXU^\f =. \X\f. (A4) 
For all linear algebra related terminology and properties we refer to |31) . 

Supplementary Information B: Equation X = 

Consider the model studied numerically in [|1 and analysed for symmetric initial conditions in [7]: 

X^X^,XiO)^Xo, (Bl) 

where each X^j is real- valued and denotes the opinion agent i has about agent j. Positive values mean that agent i 
thinks favourably about j, whereas negative values mean that i thinks unfavourably about j. When i = j, Xa is a 
measure of self-esteem of agent i. More explicitly, model \B\\ can also be written entrywise: 



Xij — '^^XikXhj- (B2) 

k 

The opinions are adjusted instantaneously by a specific dynamics which takes some type of gossiping into account. 
When agent i wishes to update his opinion about agent j, he will gossip with a third agent k. We postulate that i 
adjusts his opinion about j , based on two pieces of information: (i) what agent i thinks about his gossiping partner fc, 
that is Xik, and (ii) what the gossiping partner k thinks about agent j they are gossiping about, that is Xkj. The rate 
of change in Xij is then proportional to the product of these values. Moreover, we assume that agent i gossips to all 
agents in the network in this way, and simply adds all the contributions from these interactions. Thus, if i perceives 
k as a, friend (or enemy), and k in turn perceives j as a friend as well (respectively enemy), then i will increase his 
opinion about j. This can be summarized by the familiar phrase: 



6 



"Friends of friends are friends; enemies of enemies are friends. 



Similarly, if i perceives fc as a friend (or eneray), but k perceives j as an enemy (respectively friend), then i will 
decrease its opinion about j, which can be summarized likewise by: 

"Enemies of friends are enemies; friends of enemies are enemies. " 

The same update law is used in case i, j and k are not necessarily distinct. For example, when i ~ j ~ k, the dynamics 
imply that self-esteem Xa is always boosted because it receives a non- negative contribution (X'^)ii from "gossiping 
to himself about himself . 

To develop a dynamic theory of social balance, we first review two key ingredients of Holder's (static) theory on 
social balancing, namely those of a balanced triangle and a balanced network: 



Definition 1. For model (Bl), we call a triangle of (not necessarily distinct) agents i,j and k balanced if 



XijXikXkj > 0. 

A network is said to be balanced if all triangles of agents in the network are balanced. 



(B3) 



It turns out that a balanced network takes on a specific structure, in that at most 2 factions emerge, where members 
within each faction have positive opinions about each other, but members in different factions have negative opinions 
about each other. This result is known as the Structure Theorem and we include a short proof for convenience: 

Tiieorem 1 (Structure Theorem in [2l|3j). Let X represent a balanced network. Then up to a permutation of agents, 
the matrix X has the following sign structure: 



(+) 



+ 



Conversely, if, up to permutation, X has one of these structures, then it represents a balanced network. 

Proof. Let X be balanced in the sense of Definition [T] Then every triangle i, j, k is balanced, and in particular when 
i = j — k, then: 

Xii > for all i. 

In other words, all self-esteem values of every agent in a balanced network are positive. 
li i = j and k i, it follows from the fact that Xa > 0, that also: 

XikXki > 0, 

and thus the opinions between every pair of agents in a balanced network, are of the same sign. We define the relation 

i ^ j .^=4> X^jXji > 0, 

and claim it is an equivalence relation on the set of agents. That i ^ i holds, and that i ^ j implies that j ^ i 
has already been established. What is left to show is that i ^ j and j ^ k implies that i ^ k. But this follows 
immediately from (53 1. Now consider the equivalence classes of the set of agents under this equivalence relation. Up 



to a relabelling of agents, the sign structure of X takes the following block form: 

/+ - ... -\ 



where there are p square, diagonal blocks, such that the sum of the sizes of all these blocks equals n, the number of 
agents. Each block corresponds to the subset of all agents belonging to a single equivalence class of the equivalence 
relation introduced earlier. We claim that: 

p<2. 

If not, then there would be at least 3 diagonal blocks. Pick 3 arbitrary agents i,j and k from 3 distinct equivalence 
classes. Then according to the structure of X, there holds that XijXn^Xki < 0, which contradicts (B3). 

The proof of the converse statement is immediate. □ 
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The basic question in this context is whether or not the solutions of (Bl) evolve towards a state which corresponds 
to a balanced network0 



There is some hope that this might occur since according to {B2), X^j is updated in the direction of the sign of 
XikXkj- Nevertheless, other terms in the sum in (B2) could have opposite effects, and thus it is not clear what will 
happen in the long run. 

We shall start our investigation for the special case that Xq is normal (i.e. XqXJ = XqXJ), and obtain a sufficient 
condition on Xq under which the network balances. In [2, the special case where Xq is symmetric was considered, and 
there it was shown that the network does indeed achieve balance, provided the largest eigenvalue of Xq is positive and 
has an eigenvector with only nonzero entries (the latter condition is generically satisfied) . Here we will first show that 
if Xq is normal, and has a positive, real eigenvalue with a corresponding eigenvector that has only nonzero entries, 
then the same conclusion holds. Our results therefore extend those of [7j to the case where Xq is normal, rather than 
symmetric. 



1. Normal initial condition 



We start by defining 



the set of real, normal matrices. 



JV^{X e R"''''\XX'^ = X^X}, 



Lemma 1. The set M is invariant for system (Bl) 



Proof. Let Xq be an arbitrary matrix in J\f, and let X{t) denote the solution of [Bl). Then 



- {Xit)X^{t)) = X{t)X^{t) + X{t)X^{t) = X\t)X^{t) + X{t){X^{t))\ 



dt 



and 



dt 



(x^mit)) = {X^{t)fXit) + X^it)X^{t) 



Subtracting and evaluating at t = yields 

d 
dt 



{X{t)X^{t) - X^{t)X{t)) \t=Q = 0, 



because X{Q) eN. □ 
Recall that normal matrices are (block)-diagonalizable with blocks of size at most 2 by an orthogonal transformation: 
Lemma 2. // Xq G M , then there exists an orthogonal U such that: 

(Ai ... ... 0\ 



U^XqU = 



Ak 
Bl 





=: Ao, 



where each Ai is a real 1x1 block, and each Bj a real 2x2 block of the form: 



Ai = (fli) and Bj = ^■'^ , with (3^ ^ 0. 



A minor technical issue is that the solution X{t) of |bT| of- limt^jX(t)/|X(t)|j. instead, and say that the network evolves 

ten blows up m finite time t as we shall see later. To resolve ^ balanced state, if this matrix limit is balanced, 

this problem we investigate the sign pattern of the matrix limit 
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We have the following simple observation: 

Lemma 3. Let Xq G Af, and let {U, Aq) he as in Lemma^ // A(t) is the solution to the initial value problem A — A^, 
A(0) = Ao, then 

X{t) := UA{t)U^, 



is the solution to {Bl). 

Proof. Note that X{0) = UAqU'^ = Xq, as required, and that multiplying A = A^ by [/ and U'^ on the left and right 
respectively, yields that: 



T\2 



dt 



(UAU^) = (UAU^) 



which expresses that X{t) = UA{t)U'^ satisfies the equation X = X^ 



□ 



This Lemma shows it is sufficient to solve system {Bl) in case of scalar X or in case of a specific, 2x2, normal 
matrix X. The scalar case is easy to solve: the solution of i = x^, a;(0) = xq, is 



xit) = 



.To 



1 — XQt ' 

which is easily verified, so we turn to the 2x2 case by considering: 



X = X"^, X{0) = 



a /3 
~f3 a 



where (3 > 0. 



(B4) 



(B5) 



Lemma 4. The forward solution X{t) of {B5) is defined for all t G [0, +oo) , and 

X(t) y/2 
lim X(t) — and lim — — = 12- 

t^+oo t-^+oo \X(t)\F 2 



Proof. Let 



where 



Xq = So + Aq, So = al2, Aq = 13J2. 



1 

-1 



(B6) 



Then the solution X{t) of (B5) can be decomposed as S{t) + A{t), where 

S = S^ + A^, S{Q) = Sq, 
A = AS + SA, A{0)^Aq. 



(B7) 
(B8) 



Note that ( B7 1 is a matrix Riccati differential equation with the property that the set 

£ := {sl2 + aJ2\s, a G M}, 

is an invariant set under the flow. Therefore it suffices to solve the scalar Riccati differential equation corresponding 
to the dynamics of the scalar coefficients s and a: 



s — s'^ — a^, s(0) = a, 
a — 2as, a(0) = /3, 



(B9) 
(BIO) 



Let us determine the orbits of system {B9] — {BIO), which are given by solutions to the homogeneous differential 
equation: 



da_ 2(f) 



2 ■ 
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111?,,/ 

'/A 




FIG. 4. Phase portrait of system (_B9l — (BIO I. Circular orbits in the upper half plane (a > 0) are traversed counter clockwise, 



whereas circular orbits in the lower half plane (a < 0) are traversed clockwise. 



Set z — a/ s. Then z satisfies the following equation: 



dz 
ds 



da 1 
ds s 



a 

72 



z{l + z^) 



a separable equation, whose solution is given implicitly by: 

z 



c, 



where c is an integration constant. Replacing z by a/s, we obtain after some algebraic manipulations, that the orbits 
of system {B9\ — (BIO) are given by the circles: 



1 

2^ 



if c 7^ 0, 



which are centered at (0, l/2c) and pass through (0,0), and by 

a = if c = 0. 

The phase portrait of system {B9 \ — (BIO I is illustrated in Figure |4j 

Orbits in the upper-half plane (a > 0) are traversed counter-clock-wise, whereas orbits in the lower-half-plane 
(a < 0) are traversed clock-wise. In particular, all solutions {s{t),a{t)) of system {B9\ — {BIO), not starting on the 
s-axis, converge to zero as t — > -l-c», and approach the origin in the second quadrant for solutions in the upper-half- 
plane, and in the third quadrant for solutions in the lower-half-plane. Moreover, since the s-axis is the tangent line 
to every circular orbit at the origin, the slopes a{t)/s(t) converge to along every solution: 



a(t) 
hm -H = 0. 

t^+oo s{t) 



(BIl) 



Consequently, the forward solution X{t) of {B5) satisfies: 



lim X{t) = lim S(t) + A{t) = lim 



s{t) a{t) 
-a(t) s{t) 



= 0, 
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and by (-Bill, it follows that 



s{t) a{ty 

lin. ^ = lin. V-"^^) 

t^+^ \Xit)\F t^+^ V2\s{t)\^l + ia{t)/s{t))2 



Combining Lemma |3] and |4] yields our main result in the normal case: 
Theorem 2. Let Xq € Af, and let ([/, Ao) be as in Lemma^ Define 

- J l/ai ifai>0 
ti = < for all I = 1, 

+00 «/ fli < 



V2 



and let 



t — min ti 



Then the forward solution X{t) of {Bl ) is defined for [0, i). 

If there is a unique i* G {1, . . . , k\ such that t = ii- is finite, then 



Xit) 



lim . ^ , , , 
t^U.^ \X(t)\F 



where Ui-' is the i*th column of U , an eigenvector corresponding to eigenvalue Oi* of Xq. 
Proof. Consider the initial value problem: 

A = A^, A(0) = Ao. 

By Lemma |4] its solution is given by 

... ... \ 

1 — ait 



A(t) 






V 







1 — a/^t 

Xi{t) 



□ 



defined for all t in [0, +oo), and converges to 



where for all j = 1, . . . , I, Xj{t) is the forward solution of {B5), which is 
as t — > +0O by Lemma |4] 

This clearly shows that A(t) is defined in forward time for t in [0,t). Since by Lemma |3j the solution of {Bl) is 
given by X{t) = UA{t)U^, X{t) is also defined in forward time for t in [0,t). It follows from ^A3\ that 



X{t) 

\x{t)U 



\A{t)\p 



If i* G {1, . . . , fc} is the unique value such that t — ti* , then using (AA): 



lim 



Xit) 



, X , = U lim , . , , , 

t^tj \X{t)\F t^i- \A{t)\F 

where e,. denotes the i*th standard unit basis vector of M" 



U'^ = Uei.ejM'^ = U.^Uf,, 



□ 



Remark 1 . Theorem [2] provides a sufficient condition guaranteeing that social balance in the sense of Definition [T] 
is achieved: If Xq has a simple, positive, real eigenvalue Oj* , and if no entry of the eigenvector Ui- is zero, then 
the network becomes balanced. Indeed, there holds that, up to a permutation of its entries, the sign pattern of the 
eigenvector Ui* is either: 



= (+) or (-) 



(+), 
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or 




In either case, Theorem [T] implies that the normahzed state of the system becomes balanced in finite time. 

This result therefore extends the result of [7] to the case where Xq is normal, rather than symmetric. As we will 
see in the next subsection, the class of normal initial conditions is generically the largest class of initial conditions for 
which this is the case. 



2. Generic initial condition 



Although Theorem [2] provides a sufficient condition for the emergence of social balance, it requires that the initial 
condition Xq is normal. But the set JV of normal matrices has measure zero in the set of all real n x n matrices, and 
thus the question arises if social balance will arise for non-normal initial conditions as well. We investigate this issue 
here, and will see that generically, social balance is not achieved. 

If Xq is a general real n x n matrix, we can put it in real Jordan canonical form by means of a similarity transfor- 
mation: 



X{0) = TAoT-i := T 












Ak 
Bi 





(B12) 



where 



A,. - 



a,. 







\0 ... aj 



(C, h 

a 

V 







(B13) 



There holds that: 



Lemma 5. Let Xq E M"^", and let (T, Aq) be as in (512). If A{t) is the solution to the initial value problem A = A^, 
A(0) = Ao, then 

X{t) := TA{t)T^\ 



is the solution to {Bl). 



Proof. Note that A(0) = TAqT^^ = Xq, as required, and that multiplying A = A^ by T and T^^ on the left and 
right respectively, yields that: 



d_ 
di 



which expresses that X{t) — TA{t)T ^ satisfies the equation X = A^ 



□ 



This Lemma shows that it is sufficient to solve system (Bl ) in case of specific block-triangular X of the form Ai or 



Bj as in (_B13|. To deal with the first form Ai, we first we consider more general, triangular Toeplitz initial conditions: 



/xi(0) 2:2(0) 2:3(0) 
a;i(0) X2{Q) 



A(0) = 



a;„(0) 
a;„-i(0) 





V 



xi(0) 0:2(0) 
a;i(0) / 



, Xi{Q) reals. 



(B14) 



and denote TT — {X | A is of the form (i?14|}. It turns out that this is an invariant set for the system: 
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Lemma 6. The set TT is invariant for system {Bl ). 



Proof. It is easily verified that if X belongs to TT, then so does X'^, from whieh the proof follows. 



□ 



We use this Lemma to solve equation (Bl) in case ^(0) is a Jordan block. 
Lemma 7. Let X{0) e TT with 

(a^Oifi = l 
lifi^2 
otherwise 



Then the forward solution X{t) of (Bl I is defined on [0, t*) where t* = l/a if a > and on t* = oo if a < 0, belongs 
to TT, and satisfies 



1 

1-at 



, te [Q,t*), 



Xi{t) ^Pi 

where each Pi{z) is a polynomial of degree i: 

Pi{z) 

where oi is some real constant, so that pi{z) has no constant or first order terms when i>l. 



az if i = 1 

—k^z^ + ■ ■ ■ + Ciz'^ otherwise 



(B15) 



Proof. First note that system (Bl ) can be solved recursively, starting with xi{t), followed by X2{t), X3{t), .... Only 
the first equation for xi is nonlinear, whereas the equations for 0:2,3:3,... are linear. To see this, we write these 
equations: 



The forward solution for xi is: 



Xi, xi(0) = a if « = 1 

{2xi{t))x2, X2{0) = 1 if i = 2 

{2xi{t))xi + YlTJ2^k{t)xi-(k-i){t), Xi{0) = if J > 2 



xiit)^- -, te[0,r), 

1 — at 



(B16) 



which establishes the result if i = 1. The forward solution for X2 is 

1 



X2{t) 



(1 - aty 



, [0,f), 



which establishes the result if i = 2. If z > 2, we obtain the proof by induction on n. Assume the result holds for 
i = 1, . . . , n, for some n > 2, and consider the equation for Xn+i. Using that x„(0) = for n > 2, the solution is given 
by: 



+ / \ J2xkis)x,,^k+2{s)j e/o 



Since 



there follows that: 



J^2x^is)ds ^ ^ ^ and thus efo -'^^^i^)d-r = l/x2(s) = (l-asf, 

(1 — at)^ 



Xn+lit) = 



/ (^M^/i^~as))Pn-k+2{l/{l-as))^{l-asfds 
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Since the polynomials appearing in the integral take the form of (Bib), they are all missing first order and constant 
terms, and thus there follows that: 



x„+i{t) 



1 

(1 - at)2 
1 



Jo I re, ""-Ml -a. 



.k=2 

(n- 1 



as)"+2 
1 



H h CfcC„_fe+2 



(1 -as)4 



(1 — as) ds 



(-a)(l -ai)2 L a 

1 1 
a"-i (1 - at)"+i 



"-2 (n - 1)(1 - as)"-i 



(1 - as) 



s=0 



(1 - at)' 



r, [0,r), 



where if„+i and c„+i are certain constants (which are related in some way which is irrelevant for what follows). This 
shows that x„+i{t) is indeed of the form p„_|_i(l/(l — at)) with p„+i(z) as in (i?15|. □ 



Next we consider equation {Bl ) in case X{0) is a block triangular Toeplitz initial condition: 



/Si(0) 52(0) ^3(0) 
Si(0) 52(0) 



XiO) 





V 



Bn(0) \ 

Bn-M 



Bi{0) B^iO) 
Si(0) / 



B^{0) = 



Oil Pi 

-Pi a. 



, ai, Pi reals, 



(B17) 



and denote BTT ^ {X \ X is of the form (517)}. There holds that: 



Lemma 8. The set BTT is invariant for system {Bl I. 

Proof. It is easily verified that if X belongs to BTT, then so does X'^, from which the proof follows. 



□ 



We use this Lemma to solve equation (Bl) in case X{0) is a real Jordan block corresponding to a pair of eigenvalues 
a±jp. 



Lemma 9. Let X{0) e BTT with 



Bi(Q) 




if 1^1 



Then the forward solution X{t) of (Bl ) is defined on [0, +oo), and it belongs to BTT- 

Proof. Just like in the proof of Proposition [t] we note that system (Bl ) can be solved recursively, starting with Xi{t), 
followed by X2{t), X^lt), .... Only the first equation for Xi is nonlinear, whereas the equations for X2,X3, 
linear. To see this, we write these equations: 



are 



Xl Xi(0) = 



a P 



iii = l 



X,, 



-P OL 

{2Xi{t))X2, ^2(0) =/2 if 1 = 2 



(B18) 



_{2Xi{t))X, + Y!k=2Xk{t)X,_(k-i){t), X,(0) =0ifi>2 
Here we have used the fact that XiXi + XiXi = 2XiXi, since any two matrices of the form 



P q 

~q p 



, p, q reals , 



commute, and since by Lemma [s] the matrices Xi{t) are of this form. 

By Lemma|4j the forward solution for Xi (t) is defined for all t in [0, +oo) (and in fact, converges to zero as t 
Since the Xi{t) commute for every pair of t's, the forward solution for X2{t) is given by |32) : 



X2{t) = e^'^^it^)"^^ .12 = e^'2^l(^)'^^ t e [0,+oo), 



14 



where this solution exists for all forward times t because Xi{t) is bounded and continuous. Similarly, the forward 
solution for Xi{t) when i > 2, is given by the variation of constants formula: 



I ^2"'(^) (^^Xk{s)X,_^k-i)is?j ds 



, t e [0, +oo) when i > 2, 



where these solutions are recursively defined for all forward times because the formula only involves integrals of 
continuous functions. □ 

Combining Lemma [5] and |9j puts us in a position to state and prove our main result: 



Theorem 3. Let X{0) e M"''" and (T, Aq) as in (|B12|) with ( |gl3| . Let ai > a2 > ■ ■ ■ > ak with ai > a simple 
eigenvalue with corresponding right and left- eigenvectors Ui and respectively: 

X{Q)Ui = aiUi and X{Q) = aiV^ . 



Then the forward solution X{t) of {Bl ) is defined for [0, 1/ai), and 

lim J^^Jh^ 

t^Y/a^ \X{t)\F \UiV^\f 

A = A^, A(0) = Aq 



Proof. Consider the initial value problem: 



By Lemma [5] its solution is given by 



A(t) 



V 







Ak{t) 
Bi{t) 



where for all i = 1, . . . , A:, Ai(t) is the forward solution of W\l with ^^(0) of the form Ai in (i?13 
[rjis defined for all t e [0, l/ai). Since O i > 02 > • • • > cl^, Ai{t) blows up first w hen t 1/ai 



\ 



Bi{t)J 



, which by Lemma 
'he matrices Bj{t), 
9| they are defined 



j = 1, . . . ,1, are the forward solution of {Bl I with Bj{0) of the form Bj in (513), and by Lemma 
for all t in [0, +00). 

This clearly shows that A(t) is defined in forward time for t in [0, 1/ai). Since by Lemmajs] the solution of {Bl ) is 
given by X(t) = TA{t)T^^, X{t) is also defined in forward time for t in [0, 1/ai), and it follows that 



X{t) ^.^ Aft) 

t-i'l/ai \X{t)\F t^l/ai \X{t)\F 



lim 



Te^ejT-^F \U^V^\f' 



where ei denotes the first standard unit basis vector of ] 



□ 



Remark 2. Theorem [3] implies that social balance is usually not achieved when X(0) is an arbitrary real initial 
condition. Indeed, if Xq has a simple, positive, real eigenvalue Oi, and if we assume that no entry of the right and left 
eigenvectors Ui and are zero (an assumption which is generically satisfied), then in general, up to a permutation 
of its entries, the sign patterns of Ui and are: 



and = (+ 



f+ - 













Then Theorem [T] implies that the normalized state of the system does not become balanced in finite time. 

This shows that in general, unless Xq is normal (so that Theorem[2]and Remarkjljare applicable), we cannot expect 
that social balance will emerge for system (Bl). 
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Supplementary Information C: Equation X = XX^ 



Consider 



X = XX'^,X{Q) = Xo, 

where again, each Xij denotes the real-valued opinion agent i has about agent j. As before, for i = 
Xii is interpreted as a measure of self-esteem of agent i. We can also write the equations entrywise: 

Xij = XjkXjk- 

k 



(CI) 



the value of 



(C2) 



In this case, when an agent i wishes to revise his opinion about agent j, and talks to a third player k about j, 
agent k does not report what he thinks of j, but what j has done unto him, that is Xkj- Alternatively, when an 
agent i wishes to adjust his opinion about agent j, i and j will share their opinion about a third player k, and if 
these opinions have the same sign, then agent i will increase his opinion about agent j, whereas if these opinions have 
different signs, agent i will decrease his opinion about agent j. The rate of increase or decrease is proportional to the 
product of the opinions involved, and as before, agent i adds the terms resulting from gossiping to j about all other 
agents in the network. 

Notice there is a subtle difference in the interpretation of how information resulting from gossiping is used in models 
(Bl I and (CI ). In the former model, when agent i wants to update his opinion about agent j, agent i gossips about 



agent j to all agents in the network. In the latter model however, agent i makes the adjustment based on the outcome 
of gossiping with agent j about all agents in the network. Mathematically, the only difference between the assumptions 
of model (B\ ] and (CI I lies in the second piece of information (ii) used to update the opinion Xij. 



These differences force us to revise the concepts of a balanced triangle and a balanced network: 



Definition 2. For model (CI I, we call a triangle of (not necessarily distinct) agents i,j and k balanced if 



-^ij -^i k j k 



> 0. 



A network is said to be balanced if all triangles of agents are balanced. 

Despite this revised Definition, it is not hard to see that both Definitions [l] and [2] of a balanced network, are 
equivalent. To see this, it suffices to simply perform the permutation {i,j,k) o {i,k,j). Henceforth we can and 
will refer to a balanced network when both equivalent definitions of socially balanced network hold. Recall that 
the Structure Theorem, Theorem [l] holds for socially balanced networks, and that the basic question in the current 
context is whether or not the solutions of (CI) evolve towards a state which corresponds to a balanced network. 



Possibly competing terms of opposite sign in the sum in (C2), show it is not clear what will happen in the long run. 

As in the case of model X = X'^, we split up the analysis in two parts. First we consider system (CI ) with normal 
initial condition Xq, and we shall see that not all initial conditions lead to the emergence of a balanced network in 
this case, in contrast to the behavior of [Bl). Secondly, we will see that for non-normal, generic initial conditions Xq, 



we typically do get the emergence of social balance, also contrasting the behavior of {Bl ) 



Normal initial condition 



We start with an invariance property for system (CI I 



Lemma 10. The set M is invariant for system (CI) 



Proof. It is easily verified that if X belongs to Af, then so does XX^ , from which the proof follows. 
The next result implies that we can restrict the analysis of (iCll) to one or two-dimensional blocks. 



Lemma 11. Let Xq G Af, and let {U,Aq) be as in Lemma^ If A{t) is the solution to the initial value probl 
A = AA"^, A(0) = Ao, then 

X{t) := UA{t)U^, 



□ 



em 



is the solution to (CI). 
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Proof. Note that X(0) = UAqU^ = Xq, as required, and that muhiplying A = AA-^ by U and U'^ on the left and 
right respectively, yields that: 

which expresses that X{t) — UA{t)U'^ satisfies the equation X ~ XX^ . □ 



This Lemma shows it is sufficient to solve system (CI I i n ca se of scalar X or in case of a specific, 2x2, normal 
matrix X. The scalar case is easy to solve and follows Eq. (B4), so we turn to the 2x2 case by considering: 

X = XX'^, X{Q) = ("^p Q , where p^Q. (C3) 



We define the angle as: 



Lemma 12. Define t as 



— arctan 



(C4) 



Then the forward solution X{t) of (C3) is: 



Moreover, 



Proof. Let 



^WH'^"l^r^%tan(?. + .J'^-[M-)- (C6) 



hm Xit) = (+^ / ] and lim = ^1,. 

t-,t- ^' +(x,) t^i-\X{t)\F 2 



Xo = 5o + Ao, 5o = ^0 - ( ^) . (C7) 



Then the solution X{t) of (C3| can be decomposed as S{t) + A{t), where 

S^{S + A){S- A), S{Q)^Sq, (C8) 

i = 0, A(0) = Ao, (C9) 

which reduces to 

S = {S + Ao){S-Ao), 5(0) = 5o (CIO) 

A{t) = Aa. (Cll) 



Note that (CIO) is a matrix Riccati differential equation with the property that the line 

is an invariant set under the flow. Therefore it suffices to solve the scalar Riccati differential equation corresponding 
to the dynamics of the diagonal entries of S: 

s = + P'^, s(0) = a, 

whose forward solution is: 

s{t) = ^ tan (/3t + 0) , i G (0,t), 
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where t is given by (C5). Consequently, the forward solution X{t) of (C3| is given by: 

tan(/3i + 0) 



X{t) = Sit) + Ao = 



te{0,t), 



and thus 



lim Xit) = 



-P /3tan(/3i + 0) 

/ \ and ^^^-^^ = ^/.. 

i^t- \/2|/?sec(/?t + 0)| 2 



Combining Lemma [TT] and [12] yields our main result: 
Theorem 4. Let Xq e A/", and let ([/, Ap) &e as in Lemma^ Defi 

\/ai if ai> 



ti = < ' " ' _ for all i ^ 1, . . . ,k, 

+00 if tti < U 



and 



where 



and let 



tn = 



arctan 



2/3, [3, 



for allj = 1,...,;, 



— )e(--,-) for all j = 1, . . . ,1, 



t = min{ii, tj}. 



□ 



Then the forward solution X{t) of { CI ) is defined for [0, i). 
If there is a unique i* € {1, . . . , k\ such that t = ti* is finite, then 

where Ui' is the i*th column of U , an eigenvector corresponding to eigenvalue Oi* of Xq. 
If there is a unique j* G {1, . . . ,1} such that t = ij- , then 

lim ———7— — —:rUr'U^,, 
t^i,,- \X{t)\F 2 ^ ^ ' 

where Uj* is an n x 2 matrix consisting of the two consecutive columns of U which correspond to the columns of the 
2x2 block Bj* in Aq. 



Proof. Consider the initial value problem: 



By Lemma [T2| its solution is given by 



A = AA^, A(0) = Aq, 
■•■ 

l — a\t 



Mt) 






V 







1 — Ofct 

Xi{t) 







\ 
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where for all j = 1, . . . ,Z, Xj{t) is given by the 2x2 matrix in (C6) with /3, </> and t replaced by /3. 
res pect ively. This clearly shows that A(t) is defined in forward time for t in [0,t). Since by Lemma 11 the solution 



J, <yj and tj 



of (CI) is given by X(t) = UA{t)U , X{t) is also defined in forward time for t in [0,t). It follows from (^3 1 that 



X{t) 



If i* e {1,. 



i^wif \m\F 

, k} is the unique value such that t = U*, then 
Xit) A{t) 



lim ^ , = [/ lim , , , , , 



where e,j. denotes the i*th standard unit basis vector of M". 

If j* G {1, . . . , Z} is the unique value such that t — tj- , then by Lemma 
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lim - — /J 

t-t* \X{t)\F 



2 J 2 J 



where -Ej* has exactly two non-zero entries equal to 1 on the diagonal positions corresponding to the block Bj» in 
Aq. □ 

Remark 3. A particular consequence of Theorem [4] is that if Xq has a complex pair of eigenvalues, the solution of 



( CI I always blows up in finite time, even if all real eigenvalues of Xq are non-positive. Recall that the solution of ( Bl ) 
blows up in finite time, if and only if Xq has a positive, real eigenvalue. Another implication of Theorem [4] is that if 
blow-up occurs, it may be due to a real eigenvalue of A'o, or to a complex eigenvalue. In contrast, if the solution of 
(Bl) blows up in finite time, it is necessarily due to a positive, real eigenvalue, and never to a complex eigenvalue. 



When the solution of (CI ) blows up because of a positive, real eigenvalue o f Xq , the system will achieve balance, just 
as in the case of system (Bl ). If on the other hand, finite time blow up of (CI I is caused by a complex eigenvalue of 
Xf), we show that in general one cannot expect to achieve a balanced network. Assume there is a unique j* such that: 



lim 



xjt) 



V2 
2 



Assuming that no entry of Uj* is zero, the sign pattern of Uj*Ujl, up to a suitable permutation, is given by: 




T T 

Pi P2 

T T T 

Qi -92 93 




where all pi and qi, i = 1, 



, 4, are entrywise positive vectors, and where 

{pi,qi) + {P4,q4) = (j32,92> + {P3,q3), 



because U is an orthogonal matrix. The ? are not entirely arbitrary because Uj-Uj, is a symmetric matrix, but 
besides that their signs can be arbitrary. 



2. Generic initial condition 



Consider 



X = XX'^,X{Q) = Xo, 



(C12) 



where X is a real n x n matrix, which is not necessarily normal. 



We first decompose the flow (C12) into flows for the symmetric and skew-symmetric parts of X. Let 



X = S + A, Xo = So+Ao, 
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where S, Sq € S and A, Aq ^ A are the unique symmetric and skew-symmetric parts of X and respectively. If 
X[€) satisfies (C12), then it can be verified that S(t) and A(t) satisfy the system: 



S={S + A){S-A), 5(0) = 0, 
i 0, .4(0) ^ Ao, 



(C13) 
(CM) 



Consequently, A{t) = Aq for all i, and thus the skew-symmetric part of the solution X{t) of (C12) remains constant 
and equal to Aq. Throughout this subsection we assume that 



(C15) 



for otherwise X(0) is symmetric, hence normal, and the results from the previous subsection apply. It follows that 
we only need to understand the dynamics of the symmetric part: 



5 = (5 + Ao)(5-Ao), 5(0) -5o. 



(C16) 



Then the solution X(t) to (C12| is given by: 



X(i) = 5(t)-l-Ao, 



where 5(t) solves (C16l, and in view of (v42), there follows by Pythagoras' Theorem that: 

\X(t)\\ = \S(t)\\ + \A^\\, 

and thus 

X{i) S{t) + Ao 



(|5(i)||, + |^o||^)' 



(C17) 



Next we shall derive an explicit expression for the solution S{t) of (C16). We start by performing a change of 
variables: 



This yields the equation: 



S{t) = e-*^° S{t) e*^° . 
5 = 5^ - Al, 5(0) = So. 



(C18) 



(C19) 



We perform a further transformation which diagonalizes —Aq-. Let V be an orthogonal matrix such that: 

D'^, where D 



'V^AlV ■ 



/O 

ujjh 



\ 





/O 

UJ1I2 



\0 ... ivlhj 



\ 





\0 ... Wfe/fe/ 



where A: > 1 (because of (C15)) and all ujj > without loss of generality. Setting 

5 = V^SV, 



and multiplying equation (C19) by V on the left, and by on the right, we find that: 

S^S^ + D^, 5(0) = So := V'^SoV. 



(C20) 



(C21) 



Notice that this is a matrix Riccati differential equation, a class of equations with specific properties which are briefly 
reviewed next. 

Consider a general matrix Riccati differential equation: 



S ^ SMS - SL - L^S + N, M^M^, N ^ , L arbitrary, 
defined on S. Associated to this equation is a linear system 



H 



, H 



L -M 



(C22) 



(C23) 
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where _ff is a Hamiltonian matrix, i.e. J2nH = {JnH)'^ holds, where J2n is the matrix: 

J2n 

The following fact is well-known. 
Lemma 13. Let 



/„ 
-/„ 



(Pit)] 

[Qit)) 



be a solution of (C23). Then, provided that P(t) is non-singular, 
Sit) = Q{t)P{t)-\ 



(C24) 



is a solution of(C22). Conversely, if S{t) is a solution of (C22), then there exists a solution 



that (C24) holds, provided that P(t) is non-singular. 



(Pit) 

\Qit) 



of(C23) such 



Proof Taking derivatives in S{t)P{t) = Q{t) yields that S ^ {Q - SP)P-^, and using ( |(723| , 

S ^ {NP - L^Q - S{LP - MQ))P-^ S -SL + SMS, 



TEcn 



showing that S{t) solves (C22). For the converse, let S{t) be a solution of (C22). Let 
be the solution of ( |C23[ ) 
d 



(s:0 (ss!) ^ (/,o) 



dt 



{Q{t)p-^{t)) = QP-^ - QP-^PP-^ = {NP - L^Q)P-^ - QP-\LP - MQ)p- 



{QP-^)M{QP-^) - {QP-^)L - L^iQP- 



which implies that QP ^ is a solution to (C22\. Since S'(O) — Q{0)P ^(0), it follows from uniqueness of solutions 
that Sit) = Q{t)P~^{t). 



□ 



In other words, in principle we can solve the nonlinear equation (C22| by first solving the linear system (C23), and 
then use formula (C24) to determine the solution of (C22). 

We carry this out for our particular Riccati equation (C21 1 which is of the form (C22) if 

-.2 



M = /„, L = 0, N = 



The corresponding Hamiltonian is; 



H = 









We partition D in singular and non-singular parts: 



D 





b 



where D 



V 



where D is positive definite since all ujj > 0. Partitioning H correspondingly: 



H = 



/o 








^In-2k 




' \ 

-hk 














^0 


^2 





) 



(C25) 



This matrix is then exponentiated to solve system ( C23 ) 

Q{t) 



^ In-2k 





— tln-2k 


\) 





c 





-D-^s 








In-2k 





I 


Ds 





c ) 



m 

Q(o) 
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where we have introduced the following notation: 

' sin(wit)/2 



s{t) := 



= sm{Dt), 







and 



c(i) := 




= cos(I)t). 



By setting 



cos(a;fet)/2 y 



P(0) = J„, Q(0) = ^o 



and using Lemma 13 it follows that the solution of the initial value problem (C21 1 is given by 



S{t) = Q{t)P{t)-\, 



m 

Q{t) 



( ( In-2k 

c{t) 



D-^s{t) 




V \0 Ds{t) 



In-2k 

c{t) 



So 



(C26) 



for all t for which P{t) is non-singular. We now make the following assumption: 



Assumption A. The matrix P{t) is non- singular Jor all t in [0, t), where t is finite and such that s(t) is non-singular 
for all t in (0,f). Moreover, P{t) has rank n — 1, or equivalently, has a simple eigenvalue at zero. 



Later we will show that this assumption is generically satisfied, and also that 

t* = I 



(C27) 



where [0,t*) is the maximal forward interval of existence of the solution S{t) of the initial value problem (C21|. 
Consequently, lim(_j.f |5(i)|_F — +oo, i.e. t is the blow-up time for the solution S{t). 



Assuming for the moment that ([Aj) is satisfied, back-transformation using (C18) and (C20l, yields that the solution 
Sit) of ([C16| is: 



T -tAn 



S{t) = e'^" VS{t)V' e 

which is defined for all t in [0,f), because e*"^" V is bounded for all t (as it is an orthogonal matrix). It follows from 
(pil) that: 



S{t) 



lim , ^ , , , 
t^t\Sit)\F 



= e*-^" y I lim ^ 



Sit) 



t^t\Sit)\F 



(C28) 



Partitioning 5*0 in (C26) as follows: 

Sq = 



(•So)!! (<5'o)l2 
{So)l2 {So)22 



, with (5*0)11 = (S'o)n and (50)22 = ('S'o)^2: 



we can rewrite P(i) and Qit) on the time interval (0,f) as: 



Pit)^Ait)Mit), Ait) 



tln-2k 

D-^sit) 



, Mit) 



l/t-iSo)ii -(^0)12 

-(5o)l2 Dcit)s-\t) - iSo)22 



and 



Qit) 



iSo)i 



(So) 



c(i)(5o)l2 Dsit) + cit)iSo)22 
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Note that the factorization of P{t) is well-defined on {0,t) because by assumption ([A|), the matrix s{t) is non-singular 
in the interval (0, t). Moreover, assumption ( [A| ) also implies there exists a nonzero vector u corresponding to the zero 
eigenvalue of M(i): 

M(t}u = 0, 

and that u is uniquely defined up to scalar multiplication because the zero eigenvalue is simple. More explicitly, 



partitioning u as 



there holds that: 



l/i - (^o)ii -(^o)i2 
-iSo)f2 Dc{t)s~\t) - (^0)22 



Notice that M{t) is real-analytic on (0, -l-oo). Hence, it follows from [33] (see also [5f 
matrix U{t), and a diagonal matrix A(t), both real-analytic on (0, -|-cx)), such that: 



(C29) 

]), that there is an orthogonal 



and thus 



M{t) = U{t)A{t)U'^{t), t e (0,-l-cx)), 



M-\t) = U{t)A-\t)U^{t), t e (0,t), 



where M{t) is real-analytic as well, but only on the interval (0, t) because M{t) is only nonsingular for t < t. Returning 
to (C28), we obtain that: 



Inn — — — 
t^t \b{t)\F 



t->t\Q{t)Uit)A-^t)UT{t)A-^{t)\F 



\Q{t)uuTA-\t)\F 

Here, we have used the fact that M~^{t) is positive definite on the interval (0,f), so that its largest eigenvalue (which 
is simple for all i < t sufficiently close to t, because of assumption ([A])) approaches -l-oo -and not —00- as t — > f. 
To see this, note that M{t) is positive definite for all t > sufficiently small. Moreover, M(t) is non-singular on 
{0,t) since by assumption (A), P{t) is non-singular on {0,t), and because M{t) = A~^{t)P{t) (it is clear from its 
definition and assumption dAj) that A(i) is non-singular on (0,t) as well). Consequently, the smallest eigenvalue of 
M{t) remains positive in (OT^), and approaches zero as t t. This implies that the largest eigenvalue of M^^{t) is 
positive on (0,f), and approaches -l-oo as t ^ t, as claimed. 



Note that upon multiplication of the second row in (C29) by c{t), we obtain that: 

- yc{t){S,)l, Ds{t) + c{t)iSoh2j W " [Ds-\t)u2j - 

from which follows that 



hm_ = e 



_ ptAo y 



\{A-^t)u){A-^t)uV 



(C30) 



Plugging (C30) into (C17l, we finally arrive at the following result, which implies that system (C12) evolves to a 



socially balanced state (in normalized sense) when t t: 
Proposition 1. Suppose that assumptions (C15) and ^A\ ) hold. Then the solution X{t) o/(C12) satisfies: 

X{t) (e*^« FA-i(i)w)(e*^« VA-^{t)u)^ 



lim , , , , 

t^t\X{t)\F 



\{A-^{t)u){A~^{t)ur\F 



a. Generically, assumption fAy holds, and (C27l holds as well 
There are two aspects to assumption dAb: 
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1. The matrix P{t) is nonsingular in the interval [0,t), but singular at some finite t such that: 



t < min 

j=l,...,k OJj 



(C31) 



2. P(f) has a simple zero eigenvalue. 



To deal with the first item, suppose that the solution S{t) of (C21 ) is defined for all t G [0, t*) for some finite positive 
t* . By Lemma 13 there exist P{t) and Q{t) such that S{t) = Q{t)P^^{t), where P{t) and Q{t) are components of the 



solution of system (C23l with H defined in (C25). Then necessarily t <t*. Thus, if we can show that t* < miuj tt/luj, 
then (C31) holds. To show that t* < minjTr/Wj, we rely on a particular property of matrix Riccati differential 



equations (C22): their solutions preserve the order generated by the cone of non- negative symmetric matrices, see 
[36] . More precisely, if Si{t) and S'2(t) are solutions of ( C22[ ), and if 



then 



5i(0) ^ ^2(0), 



Si{t) ^ S2{t), 



for all t > for which both solutions are defined. Here, the partial order notation Si{t) ^ S2{t) means that the 
difference ^2 (t) — S\ (t) is a positive semi-definite matrix. 
We apply this to equation (C21 1 with 



^i(O) 



,/„ and 52(0) = 5(0), 



where we choose Ofmin as the smallest eigenvalue of 5(0) (or equivalently, of 5(0) = 5o, since 5(0) = S^V), so that 
clearly: 

5i(0) < 52(0). 



Consequently, by the monotonicity property of system (C21 ), it follows that 



5i(t) < S{t), 



(C32) 



as lon g as both solutions arc defined. We can calculate the blow-up time of Si{t) explicit ly, an d then it follows 
from (C32) that t* < t^, where t* is the blow-up time of S{t). Indeed, equations of system (C21) decouple for an 



initial condition of the form aminln, and the resulting scalar equations are scalar Riccati equations which we have 
solved before. The blow-up time for Si{t) is given by: 




:— arctan 



arctan 



(^) e (-f,f), ifami„>0 



Notice that for all = 1, . . . ,k, there holds that 



TT 

20;,- 



< 



because by definition, i^j/^j € (""'/(^'^j), 7''/(2ajj)). Consequently, 



t <f <tl < 



mm — 

3 = 1,. ...k UJ. 



which establishes (C31). In other words, we have shown that the first item in assumption rtAh is always satisfied. 



The second item in assumption ( |A[ ) may fail, but holds for generic initial conditions as we show next. For this we 
first point out that the derivative of each eigenvalue of M{t) is a strictly decreasing function in the interval {0,t), 
independently of the value of the matrix Sq- Indeed, the derivative of eigenvalue Xj{t) of M{t) equals (see [33]) : 



A, {t) = u, {tfM {t)uj {t) = u, {ty ^q/^' 
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where Uj{t) is the normahzed eigenvector of M{t) corresponding to Xj{t), and which is analytic in the considered 
interval. Since M{t) is negative definite in that interval, Xj{t) is also negative and hence all eigenvalues of M{t) are 
strictly decreasing functions of t in that interval. Suppose now that M{t) has a multiple eigenvalue at t = t, then 
M{t) is positive semi-definite since t is the first singular point of M{t) and the eigenvalues are decreasing function of t. 
If we now choose a positive semi-definite A of nullity 1 , such that M(t) + Ag^ also has nullity 1 , then the perturbed 
initial condition {So)p ^ So — A^^ yields the perturbed solution Sp{t) which can be factored as Qp{t)P~^[t), and 
where Pp{t) — A.{t)Mp{t) (note that A(i) remains the same as before the perturbation) for Mp{t) = M{t) + A^^ 
which now has a single root at the same minimal value t. To construct such a matrix A^^ is simple since the only 
condition it needs to satisfy is that M{t) and A^^ have a common null vector. Those degrees of freedom show that 
the second item in assumption ( [A| ) is indeed generic. 

Now that we have established that (|A|) generically holds, we show that (C27) is satisfied also. The proof is by 



contradiction. Earlier, we have shown that t < t* . Thus, if we suppose that (C27) fails, then necessarily t < t* . This 
implies that although P{t) is singular, the solution S{t) exists for t — t. Our goal is to show that liuit^t \S{t)\F = +oo, 
which yields the desired contradiction. 
We first claim the following: 



If M 7^ and P{t)u = 0, then Q{t)u ^ 0. 
Indeed, if this were not the case, then there would exist some vector such that: 



(C33) 



On the other hand, P{t) and Q{t) are components of the matrix product: 



(Pit) 

\Qit) 



Sq 



where H is defined in (C25|. Multiplying the latter in t — t hy u, ar id us ing the previous expression, it follows from 
the invertibility of e*^ that u = 0, a, contradiction. This establishes (C33|. 



In the previous section, we factored P(t): 



P{t) = A{t)M{t). 



Since P{t) is non-singular on [0,t), and singular at t, it follows from (C31) and the definition of A(i), that M{t) 



is non-singular (and, in fact, positive definite as shown in the previous section) on (0,f), and singular at t as well. 
Therefore, since M{t) is symmetric and real-analytic, it follows from |33j that we can find a positive and real-analytic 
scalar function e(t), and a real-analytic unit vector u(t) such that: 

M{t)u{t) = e{t)u{t), e(t) > on (0,t), e(t) = 0, |u(t)|2 = 1, 

where |.|2 denotes the Euclidean norm. In particular, M{t)u{t) = 0, and since A(t) is non-singular, it follows that 

P{t)u{t) = 0. 



Then (C33l implies that 



Define the real-analytic unit vector 



v{t) 



Q{t)u{t) ^ 
A{t)u{t) 



and calculate 



lim \S{t)v{t)\2 



\im\Q{t)p-\t)v(t)\2 



lirn 



\Q{t)M-Ht)A-Ht){A(t)um, 



lim 



\Ait)uit)U 
1 



\Q{t)u{t)y 

\A{t)u{t)\2 iTieit) 

+0O. 
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Agents either 
Cooperate or 
Defect 





C 


D 


c 


b-c 


— c 


D 


b 






FIG. 5. Prisoner's Dilemma. Both players have the option to either Cooperate or Defect. Whenever an agent cooperates, it 
costs him c = 1 while his partners receives a benefit h > c, leading to the indicated payoffs. 

Since for any real n x n matrix A, and for any unit vector x (i.e. \x\2 ~ 1) holds that \Ax\2 < |^|-Fj it follows that: 

lini|5'(t)|F = +00. 

This yields the sought-after contradiction. 

By combining Proposition [l] and the results in this subsection, we have proved the main result concerning the 



generic emergence of balance for solutions of system (C12) 



Theorem 5. There exists a dense set of initial conditions Xq in M"^" such that the corresponding solution X{t) of 



{C12 \ satisfies: 

X{t) _ (e«^o T/A-ift")M)(e*^° VA-^{t)u)'^ 
t^t\X{t)\p~ |(A-i(t»(A-i(i)u)^|F 



Proof. The set of initial conditions Xq for which condition (C15l and assumption rtAh holds is dense in M"^". □ 



Supplementary Information D: Evolutionary Dynamics 

The evolution of cooperation is an intriguing problem, which touches upon various issues in the social sciences as 
well as in biology. In general, the problem is that if defection allows individuals to gain more, why then do individuals 
cooperate? Various mechanisms for explaining the evolution of cooperation have been suggested [37], such as kin 
selection [351 13S] > reciprocity [KT or group selection f5P . Humans have a tendency however to also cooperate in 
contexts beyond kin, group or repeated interactions. It is believed that some form of indirect reciprocity can explain 
the breadth of human cooperation [8|. Whereas in direct reciprocity the favor is returned by the interaction partner, 
in indirect reciprocity the favor is returned by somebody else, which usually involves some reputation. It has been 
theorized that such a mechanism could even form the basis of morality ,42J. Additionally, reputation (and the fear of 
losing reputation) seems to play in important role in maintaining social norms [TUl [HI HSj . 

The usual idea in indirect reciprocity is that all agents have some reputation, which changes based on their actions. 
Agents are assumed to interact in a Prisoner's Dilemma type of game (Fig. [5| and can either cooperate or defect. 
Originally, the so-called image scoring strategy [44| involved an integer reputation between —5 and 5, and agents would 
cooperate if this reputation would be higher than a certain threshold. Shortly after, it was argued that a different 
strategy, known as the standing strategy, should actually perform better [45], although experiments showed people 
tend to prefer the simpler image scoring strategy Moreover, it should be of interest to agents not to cooperate 
necessarily with those of a good reputation, but to maintain their own good reputation, so that others will cooperate 
with them. This led to more systematic studies of how different reputation schemes would perform |24LI25llT7] . In this 
context, reputations are often (though not necessarily) binary (either Ciood or Bad), and can follow various possible 
schemes, such as the standing strategy or the image scoring strategy. It was shown that out of the 2,048 possible 
strategies in this framework, eight strategies perform particularly well, known as "the leading eight" . These strategies 
maintain a high level of cooperation, and effectively deal with invading defectors. 

However, these reputations are usually considered as objective. That is, all agents know the reputation Xj of some 
agent j, and all agents have the same view of agent j. Private reputations — so that we have A^j, the reputation of j 
in the eyes of i — have usually been considered by allowing a part of the population to "observe" an interaction, and 
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Initial population g + 1 Final population 




FIG. 6. Schematic of the evolutionary dynamics. The different generations are illustrated in the top row, with type A in red, 
and type B in blue. The size of the disks signify the payoff. Each agent is reproduced according to this payoff to obtain the 
population at the next generation (/ + 1. During each generation agents interact according to one of the models of social balance. 
Agents of type A use Xa = XaX dynamics, while agents of type B use Xb = XbX'^. In this case, the population evolves 
towards a state of only type B agents, due to their higher reproductivity. At that point the simulation terminates, because new 
species cannot enter as there is no mutation. 



update the reputation accordingly. If too few agents are allowed to "observe" an interaction, the reputations tend 
to become uncorrelated and incoherent. This makes reputation unreliable for deciding whether to cooperate or defect. 
The central question thus becomes how to model private reputations such that they remain coherent and reliable for 
deciding whether to cooperate or not. 

Dynamical models of social balance might provide an answer to this question. Although it allows to have private 
reputations — that is Xij — the dynamics could also lead to some coherence in the form of social balance. In addition, 
it models more explicitly the gossiping process, commonly suggested to be the foundation upon which reputations 
are forged. In addition, gossiping seems a more natural alternative than "observing" , and was found to enhance 
cooperation in various experiments [28rt30j . 



1. Simulations 

In the simulations we perform, the dynamics consist of two parts: (1) the interaction dynamics within each gen- 
eration; and (2) the dynamics prescribing how the population evolves from generation to generation. This has been 
schematically summarized in Fig. [6] The interaction dynamics are based on the models analyzed earlier (i.e. X = 
and X = XX^). Agents will decide to either cooperate or defect based on the reputation Xij{t), and the payoff 
Pi for each agent will be calculated according to the Prisoners' Dilemma type of game illustrated in Fig. [5j This 
will be discussed in more detail in the next subsection on interaction dynamics. Once the interaction is finished, the 
population is evolved according to the payoff. This will be detailed in the subsection on evolutionary dynamics. 



a. Interaction dynamics 

We have three possible types of agents in our simulations: 
Type A: uses X = X^ dynamics. 
Type B: uses X — XX^ dynamics, and 
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Defectors: who have a trivial reputation dynamics X = 0, with negative constant reputations. 

Within each generation g, all agents are assumed to interact, and for type A and B a specific reputation dynamics 
take place. We can decompose the reputation matrix X{t) into three parts: 

Xit) = Xsit) , (Df) 

where are the reputations of all agents in the eyes of agents of type A, Xsit) for type B and Xo^t) for defectors. 

The initial reputations XaIO) and Xb{0) are initialized randomly from a Gaussian distribution with mean zero and 
standard deviation one. The initial reputation for Xd(0) will be set to a fixed negative value. For the results displayed 
here we have used X£)(0) = —10, but results remain by and large the same when varying this parameter, as long as 
it remains sufficiently negative. As stated, the dynamics for type A and type B remain as in the main paper, while 
Xd will not change: 

(D2) 
(D3) 
(D4) 

These reputations blow-up at some time t*, and we numerically integrate these differential equations until this blow-up 
time. Hence, the agents are assumed to interact for a duration of t* . 

Since we are dealing with continuous dynamics in this paper, we assume all agents are involved in infinitesimally 
short games at each time instance t. Each agent i may choose to either cooperate or defect with another agent j, and 
this decision may vary from one agent to the next. For agents of type A and type B the decision to cooperate is based 
on the reputation: they defect whenever Xij{t) < and cooperate whenever Xij{t) > 0. We define the cooperation 
matrix C{t) accordingly 

(D5) 

^ [1 iiX^j>0 ^ ^ 

Defectors will simply always defect. Whenever an agent i cooperates with j the latter receives a payoff of & at a cost 
of c to agent i, as illustrated in Fig. [sj We integrate this payoff over all infinitesimally short games from time to 
time t* , which can be represented as 

1 /•«* 

P{g) ^ - / bC{tfe - cC{t)edt, (D6) 



Xa 


— XaX, 


Xb 


= XbX^ 


Xd 


= 0. 



for a certain generation g, where e = (1, . . . , 1) the vector of all ones. Each element Pi{g) contains the payoff for an 
individual agent i. The normalization by 1/n is included so that payoffs do not grow too large. 

In this context of cooperation the difference between the two models becomes quite clear, as illustrated in Fig. [7] 
Suppose an agent k cooperates with an agent j {X^j > 0) while j defects {Xjk < 0). Also suppose that i is friends 
with both j and k {Xik, Xtj > 0). In the earlier model {X = X"^) this interaction would have a positive effect on Xij, 
because XikXkj > 0, and a negative effect on k, because XijXjk < 0. Hence, the reputation of the one who defects 
increases, while the reputation of the one who cooperates decreases. Our model {X = XX^) behaves more sensibly 
in this case, and Xij would decrease and Xik would increase. Indeed, the model X — A'A"'^ is consistent with one of 
the leading eight strategies, while X = X^ is not. 



b. Evolutionary dynamics 

Now that the interaction dynamics for each generation is known, we have to specify how the generations themselves 
evolve. For all results we use n = 60 agents, which stays constant throughout the evolution. We consider four different 
schemes for initializing the first generation: 

riAiO) riBiO) noiO) 

1) Type A vs Type B 30 30 - 

2) Type A vs Defectors 30 - 30 

3) Type B vs Defectors - 30 30 

4) Type A,B and Defectors 20 20 20 



28 




FIG. 7. DifTerence between X = X^ and X = XX"^. In the context of cooperation, the difference becomes quite clear. When 
the situation is as indicated on the left, where + indicates cooperation, and — indicates defection, it will have the indicated 
effect on the right. Here, k and j are assumed to interact, whereafter i updates his opinion of k and j. In X = X^, even though 
j has defected and k is considered a friend, the relationship between i and j will actually improve. In X = XX"^ the exact 
opposite will happen, which in this case makes more sense. 



Here 71^(0), 77.5(0) and noiO) are respectively the number of agents of type A, type B and defectors in the first 
generation. The results for the first three scenarios are reported in the main text, and results for the fourth scenario 
are provided in the next section. We use the vector Ti{g) G {A,B,D} to denote the type of agent i in generation g, 
so that Ti{g) — A ii agent i is a type A player, Ti{g) = B ioi & type B player, and Ti{g) = 13 for a defector. 

These agents interact according to the interaction dynamics described in the previous subsection. We thus obtain 
a payoff Pi{g) for each agent, which we will use for evolving the population. The general idea is that the higher the 
payoff Pi{g), the more chances an individual agent i has of reproduction. The payoff Pi{g) can thus be thought of to 
represent some fitness. In classical wording, this corresponds to the "survival of the fittest" . 

We will keep the population constant at 77 = 60, and simply choose 77 = 60 new agents according to their payoff 
for the next generation. This can be thought of as choosing 60 times one of the 60 agents in the old generation for 
reproduction. Let (pi denote the probability that an agent is selected for reproduction, which we define as 



(D7) 



This is the Boltzmann probability distribution, where /3 represents a selective pressure. This scheme is often used 
in various fields such as evolutionary computation |48) . machine learning '49], and discrete choice theory [5(1. This 
evolutionary mechanism can be seen as a Wright-Fisher process ^51, with fitnesses e^^^^^\ It is well known that this 
process converges faster than a Moran birth-death process, since it essentially takes 77 time steps in a Moran process 
to reproduce the effect of one time step in a Wright-Fisher process [SI]. Because of the high computational costs 
(solving repeatedly a non- linear system of differential equations of size 77^ = 3600), this process is preferable. 

Higher /? signifies higher selective pressure, and leads to a higher reproduction of those with a high payoff, and in 
the case that /3 — > 00 only those with the maximum payoff reproduce. This corresponds to a tougher selection criteria 
for reproduction, and in the limit indeed corresponds to survival of only the fittest, since agents with a lesser payoff 
are never selected for reproduction. On the other hand, for /3 — > this tends to the uniform distribution (jii — I/77, 
where payoffs no longer play any role. We have used /3 = 1 for the results in the main text, but have also simulated 
for high selective pressure (/3 = 5) and low selective pressure (/? = 0.5). 

Since we are only interested in the number of agents of a certain type, we can also gather all payoff for the same 
types of agents, and write 

= E (D8) 

i:T,(g)=q 

where q € {A, B, D} represents the type of agent. The probability to select a type A agent, a type B agent or a 
defector is then respectively and In the next generation, the probability that agent 7 is of a specific type 

q can then be written as 



Pr(T,(5 + l)=q) = $g. 



(D9) 
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FIG. 8. Results including type A, B and defectors. 

Since we draw a random sample of n lid elements, the probability we draw k^, ks and k^ agents, is multinomially 
distributed, 

Pr(n^(5 + 1) - kA. nsig + 1) = fcs,nz3(ff + 1) = ko) = , (DIO) 

The expected number of agents in the next generation g + 1 is then E[7ig(g + 1)] = ^qU, although the actual number 
of agents may of course vary. 

We stop the simulation whenever one of the types becomes fixated in the population. With fixation we mean that 
all other types have gone extinct, and only a single type remains. For example, for the first scenario we simulate until 
either nA{g) = 60 or nsig) — 60 for some generation g. Because we include no mutation rates, only agents that are 
in the population can reproduce. If a type has become fixated, there are only agents of a single type left, so there can 
be no further evolution, and that type has said to have "won" that round. If no type has become fixated after 1,000 
generations, we terminate the simulation and count as winner the most frequent type. This almost never happens, 
and the simulation usually stops after a relatively small number of generations. 

Normally, if neither type has an evolutionary advantage (i.e. they are evolutionary neutral), the chance of becoming 
fixated in the population equals the fraction of that type in the initial population. Assuming types are evolutionary 
neutral implies their payoff is the same, and that the probabilities = 1/n. The probability that type A becomes 
fixated in the population is then = nA(0)/n, and similarly so for the other types. For example, if (as in the first 
scenario) type A and type B are initially present with ua = 30 and = 30 and neither type has an evolutionary 
advantage, both types have a probability of 1/2 to become fixated. This is also known as genetic drift (there is no 
selection), and is well known from the analysis of the Wright-Fisher model [5T]. Concluding: if a type wins more often 
than how often it was initially present, it is said to have an evolutionary advantage. 

In total, we repeat this process 1,000 times for the results in the main text, and for the low (/? — 0.5) and high 
(/3 = 5) selective pressure 100 times. This means that we run the evolutionary dynamics until one of the types has 
become fixated, and we record which type has "won" . After that, we again start from the first generation, and run 
until fixation, and repeat this. Finally, we calculate how many rounds a type has "won" compared to the total number 
of rounds, which provides the fixation probability. 

2. Results 

In addition to the results reported in the main text (scenarios 1-3), we also obtained results for populations 
initialized with type A, type B and defectors (scenario 4). These results are largely the same as for one of the types 
against defectors (scenario 2 and 3). A small difference is that type A obtains a small advantage, because it can 
benefit from type B defeating the defectors. These results are reported in Fig. [8] 

The results for the different selective pressures are reported in Fig. [9] A higher selective pressure leads to a higher 
evolutionary advantage for type B, as could be expected. A lower selective pressure levels the playing field, and allows 
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FIG. 9. Results different intensities of selection. 



type A to survive almost as frequently as type B, although still somewhat less frequently. The performance against 
defectors however remains largely unchanged for type A, and they are still unable to survive against defectors. For 
type B, they tend to win more frequently for low benefits b for low selective pressure, while for higher benefit b the 
high selective pressure allows them to thrive. This is probably due to the relatively slim evolutionary advantage of 
defectors versus type B for low b, while the advantage of type B players is quite substantial at high b. 



